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ABSTRACT 


A closed-form mathematical solution to the classical photogrammetric problem is presented. Although quite 
general, the solution is more applicable to problems in which the image-space conjugates are very difficult to match 
but one of the elements of the pair is not. Additionally, observations are made that should make the solution to the 
general problem of automatic matching less computationally intensive. This approach was used to analyze flow 
visualization data for the F-18 High Alpha Research Vehicle. The conditions for this analysis were less than ideal 
for image-to-object-space transformation. 


NOMENCLATURE 

Acronyms 
HARV 
LEX 
Symbols 

a,A,b,B, ) 

c,C,d,f, > 
m, s, t, e ; 

f,F,g,G,\ 

H,I,J,K, > 

L,r .1 

The following symbols are shown in figure 2 (p. 3). Please note that boldfaced coordinates are all located in object 
space. 

^-coordinate with respect to the reference axes (in object space) centered at the primary camera 

y-coordinate with respect to the reference axes (in object space) centered at the primary camera 

z-coordinate with respect to the reference axes (in object space) centered at the primary camera 

x-, y-, and z-coordi nates, respectively, of the primary camera with respect to the reference axes 

x-, y-, and z-coordinates, respectively, of the secondary camera with respect to the reference axes 

x-, y-, and z-coordinates, respectively, for general rotational formulas (in object space) 

x- and y-coordinates, respectively, of the photograph with respect to the optical axes of the primary 
camera (in image space) 

x-, y-, and z-coordinates, respectively, with respect to the optical axes of the primary camera 
(in object space) 

x- and y-coordinates, respectively, of the photograph with respect to the optical axes of the 
secondary camera (in image space) 


u 

V' 

w' 

x\ r, z' 

X", Y", Z" 
X R , y r , z r 


x’,y' 


x', y ', 2' 


x", y" 


High Alpha Research Vehicle 
leading-edge extension 

arbitrary constants 

functions 


x", y", z" 


X-, y-, and 2 -coordinates, respectively, with the respect to the optical axes of the secondary camera 
(in object space) 


The following symbols are shown in figure 3 (p. 4): 

pitch (elevation) of the primary camera with respect to the reference axes 
pitch angle of the secondary camera with respect to the reference axes 
roll angle of the primary camera with respect to the reference axes 
roll angle of the secondary camera with respect to the reference axes 
yaw (azimuth) of the primary camera with respect to the reference axes 
yaw angle of the secondary camera with respect to the reference axes 

INTRODUCTION 

In general, the photogrammetric problem may be defined as determining the object-space coordinates of a point, 
given two photographs of that point taken from two different perspectives. This problem has a very rich history as 
can be seen from the international interest indicated from a simple literature search. Moreover, its applications are 
varied enough to include such fields as oceanography, topography, medicine, astronomy, and aeronautics. 

The classical mathematical solution to this problem (ref. 1) is reliable and accurate if all image coordinates given 
are also accurate. This solution requires that the object be discrete and recognizable in image space and that the two 
pairs of image coordinates be matched accurately in the two perspectives. In cases, however, where the object is not 
discrete but rather a continuum of points and the isolated points on the continuum cannot be matched, the classical 
solution fails to provide accurate object-space coordinates for this particular problem. 

This particular problem was encountered in the midst of a flow-visualization experiment on the F-18 High Alpha 
Research Vehicle (HARV) at the NASA Dryden Flight Research Facility. The overall objective of this experiment 
was to study the vortical behavior and structure of the flow at high angles of attack for an F-18 aircraft using in-flight 
flow visualization (ref. 2). In an effort to provide quantitative flight data and to allow for calibration of computational 
fluid dynamic codes, it became important to accurately map out the LEX vortex core path using the existing flow- 
visualization data. The flow visualization data were acquired by two cameras. The primary camera was located at 
the right wingtip, and the secondary camera was located on the right vertical stabilizer (fig. 1). Because of the in- 
ability to isolate any single point in the continuum of points identified in the perspectives, it was impossible to 
precisely match a pair of image-space coordinates from the primary camera view (*', /) with a pair of coordinates 
from the secondary camera view (x" , y " ) (fig. 2). Since x" of the second perspective changed minimally along the 
continuum of points identified, it was possible to transform discrete points from image space to object space using 
only three image-space coordinates (jc', y') and x", or even ( x y') and y". The motivation for this paper rests in 
finding a closed-form stable solution to this classical problem that uses three image-space coordinates and, therefore, 
is not perturbed unduly by uncertain data. 

The author gratefully acknowledges the contributions of Howard R. Trent and Rodney K. Bogue of NASA 
Dryden and Denis Elliott of the Joint Propulsion Laboratory, California Institute of Technology, Pasadena, 
California. 
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* For example, NASA RECON yielded 3483 possible sources of information. 
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ANALYSIS 


The following discussion will first address the definition of both the axes system and Eulerian angles convention. 
Second, a general solution to the photogrammetric problem will be formulated. 

The reference axes system is a right-handed convention as defined in figures 2 and 3. The arrows enote t e 
positive directions of the axes, while the positive angular rotations are counterclockwise in the plane of definition. 
Let (X, Y, Z) be the coordinates of an arbitrary point (P in fig. 2) in three-dimensional space. Then the following 

equations given by 


X R - X cos <() cos ip + ysin<t> - Zcos<J>sinip 


y R = A"( sinipsin© - sin <j> cos 0 cosip) + Tcosipcos© + Z(sin0cosip + sin<j)cos0sinip) 
Z * ^(cosOsinip + sin <p sin 0 cosip) - Ycos<psin0 + Z(cos0cosip - sin<t>sin0sinip) 


( 1 ) 


( 2 ) 

( 3 ) 


are rotational equations where (X R , Y R , Z R ) represents the point (X, Y,T) in the orthogonally rotated axes system 
(ip, <(), 0). These formulas will be the basic equations used in the derivation. Note that given the axes convention an 
the physical restraint of the problem, Z < 0 implying that |Z| = -Z. 





Figure 3. Eulerian angles. 
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From elementary optics (ref. l)^r - x’, where a - f*m, /is the focal length of the camera, and m is the 


xZ 


y z 


magnification of the film (fig. 2). Clearly, X' - - ^=-, and similarly y' - - From equation (1), 


x'z' 


u'cos<j>'cosq>' + v' sin<t> r - w'cos<l>'sintp' 


(4) 


Thus 

From equation (2), 


= F(v', w\z') 



u' (sinqi'sinfi' - sin<J>'cos0'cosx|)') 

+ v' (cos<)>'cos0') + w'(sin0'cosq>' + sin<j>'cos0'sin\ji') 


Upon substituting equation (5) and simplifying, we have 

v' - G (w', z') 

Substituting equation (7) in equation (5), we have 

u' - H{ w',z') 


From equation (3), 

z' = u' (cos0'sinq>’ + sin0'cosr|i') - v'cos<|>'sin0' 

+ w' (cosG'cosxp' - sin<j>'sin0'sintj)') 

Substituting equations (8) and (7), we have 

z' = H(z', w') (cos0'sinq>' + sin^'sinG'cosrJ)') 

- G{ w', z') cos4>'sin0' + w' ( cos 0' cos ip' - sin<t>'sin0'sinq>') 


Thus 


Z r = /( w') 


Substituting equation (11) in equations (8) and (7), we have 

u ' = J (w'), v' = K( w') 


^ AZ = Z' - X" 

A Y=Y'~ Y" 

AZ = Z' - Z" 

Then the depth with respect to the secondary camera’s axes system can be written as 

z" - (u' + AZ) [cos0"sinqi" + sin<t>"sin0"cosq>"] - (v' + AT) [cos<j>"sin0"] 
+ (w' + AZ) [cos0"cosi|)" - sin<t>"sin0"sinip"] 

Substituting equation (12), we have 

Z" - L{ w') 


(5) 

( 6 ) 

(7) 

( 8 ) 
(9) 


( 10 ) 

( 11 ) 

( 12 ) 


(13) 

(14) 
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(15) 


Again from equations (14), (1), and (12), 

X " - = _ x L ( W \ » (J(w') + A*)cos<j>"costl>" + (K( w') + AY) sin f' 

a a 

-(w' + AZ) (cos<t>"sinq>") 


This is an equation linear in w thus, the solution is 


w' = s 

u'-J(s) (16) 

v' =/C(s) 

and represents the solution with respect to the reference axes system centered at the center of the principal axes of 
the primary camera. 

A similar result is possible if only y" is known using equation (2). In particular. 


= (J(w') +AX) [simp"sin0 , '-sin<|)"cose"cosH)''] 
a 

+ (K( w') + AY) [cos<j>''cos0"] 

+ (w’ + AZ) [sin0"cosrp" + sin<|>"cos0''sint|>''] 


(17) 


Equations (15) and (17) can be rewritten as follows: 

w' = g(*"); w' = r(y”) 


(18) 


Thus g ( x ") - r (y"), which simplifies to an equation of the form 

Ax"+By" + C = 0 (l 9 ) 


This equation represents the line in the projection plane of the secondary image that contains the conjugate 
( x ",y ") (ref. 3). This observation is important because it restricts the area of search required as it relates to the 
automatic matching problem (ref. 3). Moreover, the following analysis may be employed to enhance the efficiency 
of the search. 

Equation (18) may be represented as 


g(x") 


ax” + b 
cx" + d 


( 20 ) 


In addition, if is the singularity of equation (20) (i.e., =- d/c ) and - r < xg < r where It is the width of the 

photograph, then for e > 0 


[3 ( x'q + e ) + £>] [S (Xq - e) + b] 
[c ( Xq + e ) + d] [c (x" - e) +3] 


(ax'Q+b + ae) (a x'q + B- at) 
(-ce) (ce) 


( 21 ) 


* U A n T U 

Thus / (e) < 0, if E < 

a 

Then, given e to be arbitrarily small, either g ( xj) + e ) < 0 or g (x'q - e ) <0 but not both. And considering 
the axes convention, g (x) > 0 is nonsensical. Therefore, the interval of search lies in [-/, x'q - e] or [ Xq + e, rj. 
In addition, if this interval is substituted in equation (19) and subsequent restrictions are imposed on y" because of 
the photograph’s vertical dimension, an even smaller interval may result. Hence the additional restraint on the search 
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imposed by this interval could be very useful provided nothing else is known about the three-dimensional scene. If 
the approximate depth (z) is known, then equation (20) may be solved for x" in which case the above reasoning 
becomes unnecessary. 

APPLICATION 

As mentioned earlier the formulation just described was developed during an F-18 experiment at NASA Dryden 
in an effort to accurately map the leading-edge extension (LEX) vortex core path from in-flight off-surface flow 
visualization. A smoke-generator system that injected smoke into the flow field was used on the F-18 HARV (ref. 4) 
to visualize the LEX vortex core in flight at high angles of attack (fig. 1). From still and video images recorded on 
board, image-space coordinates corresponding to the path of the vortex core from two opposing views were 
tabulated and processed to output object-space coordinates in an aircraft coordinate system. 

Figures 4 and 5 show the right-wingtip primary camera view and the right-vertical-tail secondary camera view 
of the LEX vortex core along with the vortex core burst point. Shown also on these figures are the image-space 
coordinates (x',y') and (x", y") as projected on the center of the photos. Image-space coordinates from the 
primary view, (*', /), were matched with x" of the secondary view. Since x" of the secondary view typically 
changed by less than half an inch from the beginning to the burst point of the vortex core, the uncertainty in x" was 
kept to within +0.0625 in. In addition, taking into account small displacements in the camera position and rotation 
caused by the aeroelasticity of the F-18 HARV, the accuracy of the solution sets was limited to 4 in. or 2 percent of 
the actual aircraft length. This uncertainty slightly increased to 6 in. with increasing angle of attack since the width 
of the vortex core increased, thus limiting the ability of the smoke to precisely define the vortex core. 

The object-space coordinates of the LEX vortex core path in an aircraft coordinate system are presented in 
figure 6 for angles of attack of 15.0°, 19.6°, 25.0°, 29.8°, and 35.0°. The data used for these results were taken at 
steady-state flight conditions where angle of sideslip was kept to within +0.5°. No results are shown for angles of 
attack greater than 35° because steady-state conditions were no longer obtainable at these angles of attack. 

As can be noted from figure 6, with increasing angle of attack, the vortex core path is seen to rise higher off the 
surface and move slightly inboard. These trends are consistent with the flow-visualization results reported in 
reference 2. Comparisons of the solution sets, however, could not be made quantitatively because this is the only 
quantitative solution set of the LEX vortex core path for an F-18 aircraft at high angles of attack. 
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Figure 5. Right-vertical-tail camera view of the LEX vortex core. 
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Only one time point of data was used to reconstruct each of the vortex core paths shown in figure 6. Because of 
the dynamic motion of the vortex core at these high angles of attack even during steady-state conditions, averaged 
results of the vortex path over several time points would be preferable in giving better solutions of the vortex path. 
The improvement of the image-processing techniques currently being used is underway, which will allow for better 
results. 

CONCLUSION 

A closed-form mathematical solution to the classical photogrammetric problem has been presented. 
Additionally, the observations made here should make the solution to the automatic matching problem less 
computationally intensive. 

This approach was used to analyze the F-18 High Alpha Research Vehicle flow-visualization data. The technique 
proved successful in reconstructing the vortex core paths from image space to object space where the accuracy of 
the solution sets was stated within 4 to 6 in. Comparisons of the solution sets, however, could not be made 
quantitatively because this is the only quantitative solution set of the leading-edge extension vortex core path for an 
F-18 aircraft at high angles of attack. 
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